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(54) Gateway apparatus and the method thereof 

(57) A gateway realizes a connection between a 
network where HAVi devices are hooked up and 
another network in accordance with a Play-and-Plug 
spec. (e.g. the internet protocol (IP)) other than the 
HAVi spec. An HAVi plug-in detector detects a plug-in of 
a device to the HAVi network. A virtual device functions 
as a gateway for accessing from a device plugged-in the 
IP network to the device plugged-in the HAVi network. A 
virtual device controller provides the virtual device with 
an IP identifier for accessing to the virtual device from 
the IP network, and turns the virtual device to a standby 
status waiting for connection. A pseudo address gener- 
ator generates a pseudo address for the virtual device 
to communicate with the device in the HAVi network, 
and provides the virtual device with the pseudo 
address. An address-correspondence-controller con- 
trols the correspondence between an HAVi address and 
the IP identifier both provided to the virtual device. 
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D scription 

Fl Id fth Invention 

[0001] The present invention relates to a gateway 5 
(GW) device which realizes communications between a 
plurality of electronic devices hooked up to a network 
(HAVi network) — the devices being in accordance with 
th specification of the Home Audio/Video (HAVi) archi- 
tecture -and other devices hooked up to another net- 10 
work, e.g. the internet. The present invention also 
relates to a method of the gateway. 

Background of the Invention 

15 

[0002] HAVi is a middle ware — a software disposed 
between an application and an OS — and allows home- 
use audio/video devices (AV devices) to be controlled. 
The controlling targets of HAVi are the audio/video 
devices in accordance with IEEE 1394. The HAVi spec- 20 
ification has disclosed an inter-operation by linking AV 
devices with each other as well as a Plug-and-Play 
function that allows users to operate AV devices just by 
hooking up the devices to the HAVi network. 
[0003] The HAVi specification in detail is introduced 25 
in a home-page of http://www.havi.org/ . Meanwhile, var- 
ious network-services in accordance with the internet 
protocol (IP) are available outside the homes, and an art 
realizing the Plug-and-Play among the devices hooked 
up to the internet has been already disclosed. 30 
[0004] In order to realize a communication between 
the device on HAVi network and the device on the inter- 
n t, the following problems should be overcome. 

1. A gateway (GW) apparatus accommodating dif- 35 
ferences in physical specifications and network pro- 
tocols is required. Because in these two factors, the 
HAVi devices following the communication protocol 

of HAVi specification and the devices (IP devices) 
on the internet following the internet protocol (IP) 40 
differ with each other. 

To realize the 'Plug-and-Play", in particular, 
between the HAVi devices and the IP devices, the 
following two problems, i.e. items 2 and 3, should 
be overcome. 45 

2. In order to manipulate a device plugged in the IP 
network (second network) from the HAVi network 
(first network), a user should firstly be informed that 
the device in the IP network is plugged in. Next, a 
target address such as a Uniform Resource Locator so 
(URL) and an appropriate communication protocol 
should be obtained. Then the user accesses to the 

IP device following a process required. 

3. When a user wants to manipulate the HAVi 

d vice from the IP network, the user should firstly 55 
be informed that the HAVi device is plugged in. 
Next, the user should obtain a target address for 
accessing to the HAVi device and a connecting 



process. 

4. A stream transfer of audio and video information 
is assumed in the HAVi specification, and the trans- 
fer is limited within the HAVi network. A method of 
transferring stream information b tween IP devices 
and HAVi devices is required. 

5. The HAVi specification provides the users with a 
graphical user interface (GUI) for improving opera- 
bility of the HAVi devices. Therefore, a method of 
utilizing the GUI from the outside of the HAVi net- 
work is required. 

6. When a GW function is prepared for overcoming 
the first problem discussed above, the information 
available in a GW apparatus may be not enough for 
creating a reciprocal -conversion protocol between 
the HAVi network and another network. 

Summary of the Invention 

[0005] The present invention addresses the prob- 
lems discussed above and aims to provide a gateway 
(GW) apparatus and a GW method for allowing the 
HAVi devices and devices hooked up to another net- 
work, e.g. the internet, to communicate with each other. 
[0006] The GW apparatus of the present invention 
comprises the following elements: 

first message input/output means, being coupled to 
a first network, i.e. HAVi network hooking up a plu- 
rality of devices, for sending/receiving a message 
to/from the first network; 

second message input/output means, being cou- 
pled to a second network hooking up a plurality of 
devices, for communicating to an IP device through 
an IP protocol used in the internet; 
first plug-in detector for detecting a device being 
plugged in to the first network; 
a virtual device for providing a GW function which 
allows a communication between a device on the 
first network and a device on the second network 
with each other; 

a virtual device controller for providing the virtual 
device - corresponding to the device plugged in - 
with an IP identifier upon receiving a notice of plug- 
in from the first plug-in detector, the IP identifier 
indicating an address for accessing from the sec- 
ond network to the device plugged in, so that the 
virtual device is ready for a connection command; 
a pseudo address generator for generating a 
pseudo address upon receiving a connection com- 
mand from a device on the second network to allow 
the virtual device to communicate with a device on 
the first network; and 

an address correspondence controller for control- 
ling correspondence between an address provided 
to the virtual device and an IP identifier for access- 
ing from the second network. 



BNSDOCfD: <EP 1063829A2 



3 



EP 1 063 829 A2 



4 



[0007] The structure discussed above allows th 
communication b tween the devices hooked up to the 
first and second networks. 

BrI f Description of th Drawings 5 
[0008] 

Fig. 1 is a block diagram showing a function of a 
GW apparatus in accordance with a first exemplary 10 
embodiment of the present invention. 
Fig. 2 is a structure of a virtual device in accord- 
ance with a first exemplary embodiment of the 
present invention. 

Fig. 3 illustrates a structure of a HAVi address. 15 
Fig. 4 illustrates a command table showing corre- 
spondence between HAVi and IP in accordance 
with the first exemplary embodiment of the present 
invention. 

Fig. 5 illustrates an address table showing corre- 20 
spondence between HAVi and IP in accordance 
with the first exemplary embodiment of the present 
invention. 

Fig. 6 illustrates an address for accessing to a GW 
apparatus in accordance with the first exemplary 25 
embodiment of the present invention. 
Fig. 7 is a flowchart showing a plug-in operation of 
the GW apparatus in accordance with the first 
exemplary embodiment of the present invention. 
Fig. 8 is a flowchart illustrating an operation of the 30 
GW apparatus at receiving a connection command. 
Fig. 9 is a block diagram illustrating a function of a 
GW apparatus in accordance with a second exem- 
plary embodiment of the present invention. 
Fig. 10 is a flowchart illustrating an operation of an 35 
IP plug-in detector in accordance with the second 
exemplary embodiment of the present invention. 
Fig. 1 1(a) is a flowchart illustrating an operation of 
a virtual device controller at plug-in in accordance 
with the second exemplary embodiment of the 40 
present invention. 

Fig. 11 (b) is a flowchart illustrating an operation of 
the virtual device controller at removing a device in 
accordance with the second exemplary embodi- 
ment of the present invention. 45 
Fig. 12 is an address-table showing the corre- 
spondence between HAVi side and IP side in 
accordance with the second exemplary embodi- 
ment of the present invention. 

Fig. 13 a service-table showing the correspond- 50 
ence between HAVi side and IP side in accordance 
with the second exemplary embodiment of the 
present invention. 

Fig. 14 is a block diagram illustrating a function of a 
GW apparatus in accordance with a third exem- 55 
plary embodiment of the present invention. 
Fig. 15 is a flowchart illustrating an operation of a 
HAVi plug-in detector in accordance with the third 



exemplary embodiment of the present invention. 
Fig. 16(a) is a flowchart illustrating an operation of 
a virtual device controller at plug-in in accordance 
with the third exemplary embodiment of the present 
invention. 

Fig. 16(b) is a flowchart illustrating an operation of 
the virtual device controller at removing a device in 
accordance with the third exemplary embodiment 
of the present invention. 

Fig. 1 7 is a block diagram illustrating a function of a 
GW apparatus in accordance with a fourth exem- 
plary embodiment of the present invention. 
Fig. 18 illustrates an operation sequence for estab- 
lishing a stream connection in accordance with the 
fourth exemplary embodiment of the present inven- 
tion. 

Fig. 1 9 illustrates an operation sequence for discon- 
tinuing the stream connection in accordance with 
the fourth exemplary embodiment of the present 
invention. 

Rg. 20 is a plug-control-table in accordance with 
the fourth exemplary embodiment of the present 
invention. 

Rg. 21 is a block diagram illustrating a function of a 
GW apparatus in accordance with a fifth exemplary 
embodiment of the present invention. 
Rg. 22 illustrates an operation sequence of the GW 
apparatus in the fifth embodiment for obtaining 
information of Data Driven Interaction (DDI). 
Rg. 23 illustrates an operation sequence of GUI in 
the fifth embodiment 

Rg. 24 shows a GUI based on DDI information in 
accordance with the fifth exemplary embodiment of 
the present invention. 

Rg. 25 shows DDI information in accordance with 
the fifth exemplary embodiment of the present 
invention. 

Rg. 26 shows a GUI code 

Rg. 27 is a block diagram illustrating a function of a 
GW apparatus in accordance with a sixth exem- 
plary embodiment of the present invention. 
Rg. 28 shows information down-loaded from a vir- 
tual device in accordance with the sixth exemplary 
embodiment of the present invention. 
Rg. 29 is a flowchart illustrating an operation of 
down loading the virtual device in accordance with 
the sixth exemplary embodiment of the present 
invention. 

Description of the Preferred Embodiments 
Exemplary Embodiment 1 

[0009] A gateway (GW) apparatus in accordance 
with the first ex mpfary embodiment of the present 
invention is hereinafter demonstrated with reference to 
the accompanying drawings. All the descriptions in this 
embodiment are in accordance with the specification of 
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HAVi 1 .0 beta; however, the present invention is not lim- 
ited to an edition of HAVi. 

[0010] In Fig. 1, HAVi devices 101 include AV 
devices such as a digital television receiver (DTV), a 
video tape recorder (VTR) and th like. The AV devices 
are in accordance with the HAVi specification, and are 
connected to HAVi network (first network) 102. GW 
apparatus 103 is disposed between the IP network 
(second network) 1 04 and the HAVi network 1 02, and 
functions to allow the devices hooked up to the first and 
s cond networks to communicate with each other. GW 
apparatus is also equipped with a function correspond- 
ing to Full AV device (FAV) specified by the HAVi speci- 
fication. The IP devices 105, i.e. the devices hooked up 
to the second network, include a network printer and 
other network devices. 

[001 1 ] HAVi plug-in detector 1 06 monitors an event 
broadcast to the HAVi network. When detector 106 
d t cts a plug-in of an HAVi device, the detector informs 
virtual-device-controller 107 of the detection. Controller 
1 07 prepares an address which allows the G W function 
using a virtual device to be valid, and makes the virtual 
device be on standby. 

[0012] Pseudo address generator 108 generates 
addresses of the HAVi devices and IP devices for net- 
work entities to communicate with the virtual device. 
Address correspondence controller 109 controls the 
connections between the HAVi devices and IP devices 
as well as the correspondences of pseudo addresses 
supplied to respective devices. HAVi message 
input/output means 110 (first message input/output 
means) functions as an interface between the GW 
apparatus and the HAVi devices. 
[0013] Virtual device 111 functions as a GW con- 
verting a communication protocol, thereby manipulating 
either the HAVi devices from the IP network or the IP 
devices from the HAVi network. IP netwok input/output 
means 112 (second network input/output means) func- 
tions as an interface between the virtual device and the 
IP n twork. 

[001 4] The following description is referred to Fig. 2. 
Connection controller 202 controls the correspond- 
ences between the devices communicating over the 
GW. Command converter 203 converts commands sup- 
plied from the HAVi network and IP network into com- 
mands the targets can comprehend. The corresponding 
commands which command converter 203 refers to are 
controlled by command-correspondence-controller 204. 
The corresponding information to the commands may 
be controlled as a database stored outside the virtual 
device. If the corresponding information has been 
standardized in advance, genera I -purpose devices can 
be used as the virtual devices. Address converter 205 
converts a target address and a source address, so that 
a messag the GW receives can be transferred to 
another network. Interface 206 functions as an interface 
between the GW apparatus and IP network input/output 
means 112. Interface 207 functions as an interface 



between the GW apparatus and HAVi network 
input/output means 1 1 0. 

[0015] An address structure of HAVi is described 
with reference to Fig. 3. HAVi address 301 comprises 
5 the following elements: 

identifier (ID) 302 assigned to respective HAVi 
devices; and 

ID 303 assigned for distinguishing HAVi software 
io elements in the devices, and ID 303 is thus called a 
software element ID (SEID). The HAVi software ele- 
ment communicates with other software elements 
using the SEID. ID 302 assigned to an HAVi device 
is called a global unique ID (GUID) and is a 64-bit 
75 identifier specified by the global identifier (EU164) 
defined by IEEE. A Sw-Handle assigned for distin- 
guishing a software element in a device is a 16-bit 
identifier. The SEID thus forms an 80-bit stream. In 
this first embodiment, the SEID of a combined 
20 GUID with Sw-Handle is described "GUID-Sw-Han- 
dle" in order to avoid a long description. 

[0016] In a command-corresponding table of Fig. 4, 
HAVi command 402 corresponds to internet service 

25 command 403 on the same line. This information may 
be stored in an independent database, and this corre- 
spondence may be programmed. 
[0017] In the table shown in Fig. 5 — the table con- 
trolling the address-correspondence between the HAVi 

30 and the internet ~~ column 502 stores a connection 
between the GW apparatus and IP devices communi- 
cating with the virtual HAVi device. The connection of 
column 503 on the same line indicates a corresponding 
address (SEID) of the HAVi side. Further, the same line 

35 of column 504 indicates an access identifier to the inter- 
net. In this example, it is assumed that the HAVi GUID 
of the GW apparatus is "10" and an identifier on the IP 
side is "192.0.0.1". 

[0018] Fig. 6 shows an address used in the access 
40 to the GW apparatus from the HAVi and the IP side 
respectively. An address-assignment to a virtual VTR 
and IP client 1 is shown in Fig. 5. From the IP side, an 
access is done to the address of "192.0.0.1 :8080", and 
the return access from an HAVi device is addressed to 
45 "10-2". 

[0019] Based on the flowchart in Fig. 7, an opera- 
tion of the GW apparatus when an HAVi device is 
plugged in the HAVi network is demonstrated with refer- 
ence to Figs. 1 and 2. 

so [0020] The HAVi device plugged in the HAVi net- 
work broadcasts the plug-in to the HAVi network and an 
event noticeable to the other HAVi devices, e.g. a new 
software element in HAVi 1 .0 beta. 
[0021] Plug-in detector 1 06 monitors this event, and 

55 when det ctor 1 06 detects th plug-in vent, th det c- 
tor obtains the HAVi address (SEID) of the plug-in 
device, the address being additional information to the 
event (step 701). 
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[0022] After obtaining the SEID, the detector 
searches an HAVi registry with a key of SEID (step 
702). 

[0023] The detector then obtains information attrib- 
utive to the plugged-in device such as a type of device, 
a device ID, a maker ID (step 703). 
[0024] Virtual device controller 1 07 prepares virtual 
device 1 1 1 appropriate to a GW for accessing to the 
plug-in device from the IP network, then makes device 
1 1 1 being on standby (step 704). 
[0025] The following methods are available for pre- 
paring the virtual device: 

1 . Select an appropriate device from GW programs 
prepared for various devices in advance. 

2. Produce a virtual device dynamically based on 
the device information. 

3. Inform a general-purpose GW program of the 
information about the plugged-in device, thereby 
operating the program appropriately. 

[0026] Fig. 2 shows a structure of virtual device 1 1 1 
tobeaGW. 

[0027] Virtual device controller 107 provides virtual 
device 1 1 1 with an identifier, i.e. an IP address, to start 
r ceiving an access from the IP side upon virtual device 
1 1 1 turning to a standby status (step 705). 
[0028] Then, the identifier is registered to address- 
correspondence-table 501 (step 706). 
[0029] The GW apparatus is on standby waiting for 
a connection from the IP device (step 707). 
[0030] The steps discussed above describe an 
operation-stream shown in Fig. 7. 
[0031] An operation of GW after the GW apparatus 
received a connection request from the IP device is 
described based on the flowchart of Fig. 8 with refer- 
ence to Fig. 1 through Fig. 6. 

[0032] When an access requirement is sent from 
th IP side (step 801), virtual device controller 107 
requests pseudo-address-generator 1 08 to generate a 
virtual HAVi address in order to reply from the HAVi side 
via the GW to the requirement from the IP client. 
[0033] The HAVi address comprises a Global 
Unique ID (GUID) and a Software Handle (SwHandle) 
as shown in Fig. 3. The GUID is to distinguish all the 
HAVi devices uniquely, and the SwHandle is an identi- 
fi rfor distinguishing the software element in an identi- 
cal HAVi device from other software elements. The 
SwHandle is controlled in each HAVi device independ- 
ently. This address system requires a pseudo address 
of the virtual device receiving the reply as a representa- 
tive of the IP clients to be embodied the GUID as an 
HAVi compatible device of the GW apparatus including 
virtual device 111. 

[0034] Therefore, pseudo-addr ss-generator 108 
obtains the GUID of the GW apparatus (step 802), and 
calculates and provides a SwHandle so that the HAVi 
address in the device is unique to the device (step 803). 



[0035] This newly g nerated HAVi addr ss is sup- 
plied to virtual devic controller 107. In the same man- 
ner as shown in the address-corresponding-talbe in Fig. 
5, controller 107 registers a combination of HAVi 
5 address 503, address 504 for accessing from the IP 
side, and a pair of the target devices 502 (HAVi device 
and an IP client) on address-corresponding-means 109 
(step 804). 

[0036] In this embodiment, the HAVi address is 
w supplied to the virtual device at the access from the IP 
side; however, the address can be assigned to the 
device prior to the access from the IP side. 
[0037] In an example shown in Fig.5, the GUID of 
GW is assumed W 10 M , the IP address is assumed "192. 
15 0.0.1 and the HAVi device accessed by an IP client is 
assumed a VTR. In the GW apparatus, a plurality of vir- 
tual devices may sometimes wait for connections, there- 
fore, a port ID number of the virtual VTR device is set at 
• , 8080 n for distinguishing the present connections from 
20 possible connections. However, the connections are not 
necessarily controlled by a set of an IP address and a 
port number. 

[0038] The virtual device obtains a message from 
the IP side after registering a correspondence between 

25 a connection and an address (step 805). 

[0039] The virtual device converts the HAVi com- 
mand corresponding to a command called from the IP 
side into HAVi command referring to the command-cor- 
responding-table shown in Fig. 4 (step 806). 

30 [0040] For instance, when an IP client calls a com- 
mand of RPCPIay(), the virtual device calls an HAVi 
command of VTR::Play() corresponding thereto. 
[0041] When completing the command conversion, 
the virtual device drafts an HAVi message whose 

35 source HAVi address is the pseudo address assigned to 
the virtual device, and whose target is the HAVi address 
of the VTR to communicate with. Then the virtual device 
sends the message to the target HAVi device 101 using 
HAVi message input/output means 110 (step 807). 

40 [0042] Device 101 (VTR) performs a designated 
operation upon receiving the message, and sends a 
reply-message to the virtual device of the G W if neces- 
sary. 

[0043] The communication is forwarded in the same 
45 manner until the connection is discontinued (step 805 - 
step 808). 

[0044] When either one of the HAVi devices or IP 
devices requires the connection be discontinued, the 
virtual device realizes the requirement (step 809) and 
50 closes the connections on the HAVi side and IP side 
respectively (step 810). 

[0045] At the same time, address-correspondence- 
controller 1 09 deletes the entry from the address-corre- 
spondence-control-table (step 81 1). 
55 [0046] Finally, th virtual device returns to the 
standby status if oth r connections to be dealt with do 
not exist. 

[0047] In this first embodiment, the access from the 
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IP network to the HAVi device is d monstrated; how- 
ever, the access in the reverse order can be done in th 
same manner. 

[0048] The GW apparatus in accordance with the 
first ex mplary embodiment allows the IP devices and 5 
HAVi devices to communicate with each other. 

Exemplary Embodiment 2 

[0049] The second exemplary embodiment of the 10 
present invention is demonstrated with reference to Fig. 
9 -Fig. 13. 

[0050] In GW apparatus 903 shown in Fig. 9, IP 
plug-in detector 909 obtains plug-in information of IP 
devices supplied from IP directory 915, and requests 15 
virtual device controller 907 to start an operation 
described below. Controller 907 has the following addi- 
tional function to controller 107 described in the first 
embodiment. 

[0051] The operation requested to controller 907 is 20 
this: Upon receiving a notice from detector 909, the vir- 
tual device requests HAVi registry registering means 
91 4 to register a newly added IP device to HAVi registry 
913 so that the newly added IP device can be recog- 
nized from the HAVi network. 25 
[0052] HAVi registry 913 supplies device-directory 
within the HAVi network corresponding to the registry in 
the HAVi specification. Registry 913 also realizes a 
search with an HAVi address (SEID) and the informa- 
tion attributive to devices such as a type of devices, a 30 
-maker, available functions, a nickname by a user. For 
instance, search the HAVi registry for a digital TV and 
the SEID of the digital TV hooked up to the HAVi net- 
work. The communication can be then started with this 
SEID. 35 
[0053] IP directory 915 supplies interface informa- 
tion on the IP network for searching services and for uti- 
lizing the services. 

[0054] The IP directory is not always controlled by 
one specific device intensively, but it may be controlled 40 
in the following manner. 

1. Each device broadcasts its own plug-in informa- 
tion within the network. 

2. When a device is searched, the device corre- 45 
sponding to the plug-in information replies. 

[0055] Other elements including HAVi device 901, 
HAVi network 902, GW apparatus 903, IP network 904, 
IP device 905, address-correspondence-controller 906, so 
psseudo-address-generator 908, HAVi message 
input/output means 910, virtual device 911 and IP net- 
work 912 function in the same manner as those in the 
first embodiment. 

[0056] Fig. 13 shows a s rvic -correspondence- 55 
table which stores the correspondence between identifi- 
ers of HAVi network and IP network, where the service 
includes a printer and other devices. 



[0057] An operation of GW apparatus 903 is dem- 
onstrated based on the flowcharts shown in Figs. 10 
and 11 with reference to Fig. 9, Fig. 12 and Fig. 13. 
First, an op ration of IP plug-in detector is demon- 
strated hereinafter with reference to Fig. 10. 
[0058] IP plug-in detector 909 requests IP directory 
915 — functioning as a directory server for searching 
services on the IP side — to notify an event about plug-in 
and plug-out of an IP device (step 1001). Necessity of 
requesting a notice depends on he specification of Plug- 
and-Play. 

[0059] After the request, detector 909 turns to 
standby status waiting for a notice (step 1002). 
[0060] IP device 905 requests IP directory 915 to 
plug-in using a protocol for plug-in the IP directory, and 
registers necessary data such as device data, interface 
data and a service identification. 
[0061] IP directory 915 determines whether or not 
the notified content meets the IP device 905, and noti- 
fies detector 909 of the plug-in event when directory 915 
determines the event notice is necessary (step 1 003). 
[0062] In this second embodiment, a network 
printer is taken as an example and is plugged in IP net- 
work 904. 

[0063] IP plug-in detector 909 analyzes the notice 
and determines the content (step 1003). 
[0064] When the notice introduces a plug-in of a 
new service, detector 909 detects that the network 
printer has been plugged-in according to information 
additional to the event notice (step 1 004). 
[0065] Further, detector 909 requests virtual device 
controller 907 to prepare a virtual device which is sup- 
posed to provide a plugged-in device with a GW proc- 
ess (step 1 005). 

[0066] In this second embodiment, information 
about a type of a plugged-in device is obtained from 
additional information to the event notice; however, the 
HAVi devices can request for searching a registry, 
thereby triggering the IP side to search the registry for 
the directory information. 

[0067] An operation of controller 907 when a new IP 
device is plugged in is demonstrated with reference to 
Fig. 1 1 (a). 

[0068] Upon receiving a request from detector 909, 
virtual device controller 907 inquires of IP directory 915 
to obtain the interface information of the plugged-in 
device (step 1101). 

[0069] The interface information can be obtained 
when a HAVi device searches for IP devices, or when 
the HAVi device receives a connection request via the 
GW apparatus. 

[0070] The interface information includes device- 
dependent-information for controlling the device, i.e. the 
information written by script languages such as Hyper 
Text Makeup Language (HTML), Extensible Makeup 
Language (XML), or JAVAScript (Java and JavaScript 
are trademarks of Sun Microsystems, Inc.), programs 
supplying a user interface, and application program- 
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ming interface (API) of device-control-method. 
[0071] Virtual device controller 907 prepares virtual 
device 911 appropriate as GW based on the device 
information obtained as discussed above (step 1 102). 
[0072] The virtual devic can be also prepared in 5 
this way: If a standard is available for inter-operations of 
HAVi devices and the like in different Plug-and-Play 
specifications, the virtual devices according to this 
standard for the inter-operations could be prepared, and 
then appropriate devices could be selected responsive w 
to a type of devices. 

[0073] For instance, when a network printer is 
plugged in the IP side, a virtual device of network printer 
according to the inter-operation standard is selected. 
This inter-operations standard allows the network 15 
printer according to Jini spec. (Jini is the trademark of 
Sun Microsystems, Inc.) to be manipulated from the 
HAVi side. 

[0074] Controller 907 obtains the HAVi address of 
the virtual device, i.e. SEID and HAVi Unique ID (HUID), 20 
using pseudo-address-generator 906 (step 1103). This 
is the same step as the one in the first embodiment. 
[0075] The HAVi address obtained, i.e.SEID and 
HUID, are registered together with additional data of the 
devices to HAVi registry 91 3 (step 1 1 04). 25 
[0076] The HUID functions as an identifier of an 
eternal Software Element being not subjected to the 
influence from a network reset. 

[0077] Next, HAVi registry 913 broadcasts a NewS- 
oftwareElement global event which notifies the HAVi 30 
network of a newly plugged-ln virtual HAVi device. This 
broadcasting saves the HAVi network a process of 
obtaining an IP address for manipulating a newly 
plugged-in IP devices. 

[0078] Virtual device controller 907 registers a set 35 
of the HAVi address already supplied and ID information 
on the IP side to the address-correspondence -table via 
address-correspondence-controller 906 described in 
the first embodiment, then turns the virtual device to the 
standby status (step 1 1 05). 40 
[0079] Fig. 12 shows an address -co rresponde nee - 
table. In this table, the virtual device functions as a GW 
of the network printer on the IP network, and the SEID 
viewed from the HAVi side is 10 — 5, and that viewed 
from the IP side is 192.0.0.1. Further, as shown in Fig. 45 
13, this table controls the correspondence between 
identifiers of services (the network printer in this embod- 
iment) on the internet and identifiers viewed from the 
HAVi side. The service identifiers on the internet are 
uniquely controlled by the directory service. For so 
instance, the service ID of Jini is the case. 
[0080] Upon receiving a command from the HAVi 
device, e.g. an output from an image printer, the virtual 
d vice converts the command and then sends the con- 
verted command to the IP network via IP network 55 
input/output means. 

[0081] An operation at plugging-out an IP device is 
demonstrated with reference to the flowcharts shown in 



Figs. 10 and 11. 

[0082] When the event notice on step 1003 indi- 
cates a service-out, detector 909 requests controller 
907 to carry out the service-out. 
[0083] As illustrated in the flowchart in Fig. 1 1 , the 
virtual device controller searches the service -corre- 
spondence-table shown in Fig. 13 (step 1 1 09). Then the 
controller determines whether or not the service-out is 
still plugged-in (step 1110), and when the service is still 
plugged-in, the controller deletes the entry from the 
address-correspondence-table (step 1111). The con- 
troller also deletes the entry of HAVi registry 913 (step 
1112), and stops the virtual device (step 1113). Then 
the controller broadcasts the GoneSoftwareElement 
global event which notifies the HAVi network of going 
out of SoftwareElement, thereby notifying the HAVi net- 
work of going out of the IP device (step 1114). 
[0084] When the IP service is gone out (a device is 
removed from the network in this embodiment) through 
these steps, GW apparatus 903 follows this result and is 
deleted from the HAVi registry, thereby avoiding a mis- 
match. 

[0085] The GW apparatus in accordance with the 
second embodiment as discussed above allows the 
HAVi devices to detect a device newly plugged-in the IP 
network as well as to obtain the interface information via 
the HAVi registry. 

Exemplary Embodiment 3 

[0086] A gateway (GW) apparatus of the present 
invention in accordance with another exemplary embod- 
iment is demonstrated with reference to Figs. 12-16. 
[0087] Fig. 14 is a block diagram illustrating func- 
tions of the GW apparatus. HAVi plug-in detector 1 406 
monitors plug-in events being broadcast to the HAVi 
network, and obtains plug-in information of HAVi 
devices, then requests virtual device controller 1407 to 
start the operation described below. Controller 1407 
has the following additional function to controller 907 
described in the second embodiment. The operation 
requested to controller 1407 is this: Virtual device con- 
troller 1407 requests HAVi registry registering means 
1414 to register a newly added HAVi device to IP regis- 
try 1415 so that the newly added HAVi device can be 
recognized from the IP network. IP directory 1415 and 
HAVi directory 1 413 function as same as those do in the 
second embodiment. Other elements including HAVi 
device 1401, HAVi network 1402, GW apparatus 1403, 
IP network 1404, IP device 1405, address-correspond- 
ence-controller 1 409, psseudo-address-generator 
1408, HAVi message input/output means 1410, virtual 
device 141 1 and IP network 1412 function in the same 
manner as those in the first embodiment. 
[0088] Bas d on the flowcharts shown in Figs. 15 
and 16, an operation of the GW apparatus of the 
present invention is demonstrated with reference to Fig. 
14, Fig. 12 and Fig. 13. 
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[0089] First, an operation of HAVi plug-in detector 
1406 is demonstrated with reference to Fig. 15. 
[0090] Detector 1406 requests an event controller 
of HAVi middle wear to monitor and notify an event to be 
broadcast to the HAVi n twork (step 1 501 ). 5 
[0091] In the HAVi specification, if an event is regis- 
tered to EventManager of HAVi System Software Ele- 
ment which controls an input/output of HAVi events, the 
HAVi middle wear monitors a message travelling 
through the network, and notifies the SoftwearElement 10 
(the HAVi plug-in detector in this embodiment) of the 
target event when it is broadcast. 
[0092] After the request, detector 1 406 is turned to 
a standby status waiting for a notice (step 1502). 
[0093] Upon being plugged-in, HAVi device 1401 15 
registers its own information to "Registry" — a database 
of directory information of a device to be a host — as 
specified in the HAVi specification. The Registry broad- 
casts an event (NewSoftwareElement global event) all 
over the network to notify a new plug-in. 20 
[0094] As described previously, detector 1406 
obtains the event (NewSoftwareElement event) notify- 
ing the new plug-in via the HAVi middle wear (step 
1503). 

[0095] In this embodiment, a video-tape-recorder 25 
(VTR) is plugged-in to HAVi network 1402, for instance. 
Detector 1406 obtains information of a plug-in of the 
VTR from additional information of the notified event 
(step 1504). 

[0096] Detector 1406, further, requests virtual- 30 
device-controller 1407 to prepare a virtual device in 
order to provide the plugged-in device with a GW proc- 
ess (step 1505). 

[0097] Next, an operation of controller 1407 when 
an HAVi device is newly plugged-in is demonstrated 35 
with reference to Fig. 1 6. 

[0098] Upon receiving the request from detector 
1406, controller 1407 inquires HAVi registry 1413 to 
obtain the information about the plugged-in device such 
as a type of the device, HUID, a maker and the like. This 40 
information is not be always obtained at the same time 
as the plug-in. 

[0099] Based on the device information obtained, 
controller 1407 prepares virtual device 1411 appropri- 
ate to the GW (step 1 602). « 
[0100] The virtual device can be also prepared in 
this way: If a standard is available for inter-operations of 
HAVi and Jini, the virtual devices according to this 
standard for the inter-operations could be prepared, and 
then appropriate devices could be selected responsive so 
to a type of devices. 

[0101] For instance, when a VTR is plugged in the 
HAVi side, a virtual device of VTR according to the inter- 
operation standard is selected. This inter-operations 
standard allows the VTR to be manipulated from the IP 55 
side. 

[0102] Controller 1407 obtains an identifier, e.g. an 
IP address, a port number of the virtual device using 



pseudo-address-generator 1408 (step 1 603). This is the 
same step as the one in the first embodiment. 
[0103] Controller 1407 generates interface informa- 
tion using the IP identifier obtained and additional infor- 
mation about the device (step 1604). 
[0104] The interface information includ s device- 
dependent-information for controlling the devic , i.e. the 
information written by script languages such as Hyper 
Text Makeup Language (HTML), Extensible Makeup 
Language (XML), or JavaScript (Java and JavaScript 
are trademarks of Sun Microsystems, Inc.), programs 
including a user interface such as Java applet, and 
objects including application programming interface 
(API) of device-control-method. 
[01 05] Next, virtual-device-controller 1 407 registers 
the interface information previously generated to IP 
directory 1415 following a protocol specified in respec- 
tive Plug-and-Play specifications (step 1605). 
[0106] As a result, the IP network can manipulate a 
newly plug-in HAVi device without searching for an 
access identifier or an access method. 
[0107] Virtual device controller 1407 registers a set 
of the HAVi address already supplied and ID information 
on the IP side to the address-correspondence-table via 
address-correspondence-controller 1406 described in 
the first embodiment, then turns the virtual device to the 
standby status (step 1606). 

[0108] As shown in Fig. 1 3, controller 1 407 controls 
the correspondence between the identifier of a service 
on the internet (the VTR in this embodiment) and an 
identifier to be viewed from the IP side. The VTR's iden- 
tifier has been obtained on step 1504. The identifier to 
be viewed from the internet side is specified in the spec- 
ifications of respective Plug-and-Play. 
[0109] Upon receiving a command (e.g. Record a 
program with the VTR.) from an IP device, the virtual 
device converts the command as same as in the first 
embodiment, and sends the converted command to the 
HAVi network via the HAVi network input/output means. 
[01 10] An operation at plugging-out an HAVi device 
is demonstrated with reference to the flowcharts shown 
in Figs. 15 and 16. 

[0111] When the event notice on step 1503 indi- 
cates a service-out (GoneSoftwareElement global 
event in the HAVI specification), HAVI plug-in detector 
1406 requests controller 1407 to delete the service. 
Controller 1407 searches HAVi registry 1413 with a key 
of HAVi address (SEID) — additional information to the 
event, thereby obtaining HUlDs of the remained 
devices. Next, controller 1407 searches the service-cor- 
respondence-control-table shown in Fig. 13 (step 1610) 
following the steps shown in Fig. 16, then determines 
whether or not the service-out is still plugged-in (step 
1611). 

[0112] Controller 1407 deletes the entry from the 
addr ss-correspondence-table and service-corre- 
spondence-table via address-correspondence-control- 
ler 1409 (step 1612 and step 1613). 
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[0113] Controller 1407 also notifies IP directory 
1415 of the servic -out (step 1614), th n stops the vir- 
tual device (st p 1615). 

[0114] When the HAVi service is out (a device is 
removed from the network in this embodiment) through 
these steps, the service is deleted also from the IP 
directory, so that the service-out can be recognized 
from the IP network. 

[0115] The GW apparatus in accordance with the 
third embodiment as discussed above allows the IP 
devices to detect a device newly plugged-in the HAVi 
network as well as to obtain the interface information via 
the IP registry. 

Exemplary Embodiment 4 

[0116] A gateway (GW) apparatus in accordance 
with the fourth embodiment is demonstrated hereinafter 
with reference to Fig. 17 through Fig. 20. 
[0117] Fig. 17 is a block diagram illustrating func- 
tions of the G W apparatus. 

[0118] HAVi stream controller 1716 allows HAVi 
devices in compliance with the HAVi spec, to carry out a 
stream-transfer among the devices. Virtual device 1 71 1 
has additional functions to those described in the first 25 
embodiment, i.e. (1 ) establishing a connection to the IP 
devices, and (2) keeps a band when necessary. 
Stream-port-correspondence-controller 1 71 7 controls 
the correspondence between HAVi Functional Compo- 
nent Module Plug (FCM Plug) — a control unit of stream 30 
in compliance with the HAVi spec, on the GW apparatus 
— and IP stream ports. Stream-packet-converter 1718 
converts HAVi -stream-packet to IP-stream-packet and 
vice versa, then sends out them. Other elements func- 
tion as same as those described in the first through third 35 
embodiments. 

[0119] Fig. 1 8 illustrates a sequence of producing a 
stream connection between the HAVi device and the IP 
device via the GW apparatus. 

[0120] Fig. 19 illustrates a sequence of cutting the 40 
stream produced through the sequence shown in Fig. 
18. 

[0121] In Fig. 20, stream-port-correspondence- 
table 2001 - indicating the correspondence between the 
stream ports - includes, e.g. an ID 2002 of HAVi FCM 45 
(HAVi Unique ID) which can handle the stream, FCM 
flag No. 2003 of HAVi stream includes Plug control Reg- 
ist r (PCR) NO. 2004 specified by IEC 61833 and IP 
port No. 2005 for producing a stream connection on the 
IP side. 50 
[0122] Based on the sequence shown in Fig. 18, a 
process of producing the stream connection between 
the HAV'^evice and IP device is described with refer- 

nce to Fig. 1 7 and Fig. 20. 
[0123] When IP device 1705 capabl of rec iving 55 
videos is plugged-in, the device is regist red in HAVi 
registry 1713 of GW apparatus 1703 together with in IP 
directory 1715. At this moment, the GW apparatus col- 



lects and stores the following device-information: 

(1 ) Is this device capable of handling a stream? 

(2) What kind of data-rate does this device handle? 

5 

[0124] Next, based on the sequence shown in Fig. 
1 8, the process that the HAVi device sends a stream to 
the plugged-in IP device is demonstrated with reference 
to Fig. 17 and Fig. 20. 
10 [0125] HAVi device 1701 searches the HAVi regis- 
try for video-receivable devices (step 1801). 
[0126] Since IP device 1 705 has been registered as 
a video-receivable device, GW apparatus 1703 returns 
the SEID — the HAVi address of virtual device 1711— to 
15 the HAVi device (step 1 802). 

[01 27] The HAVi device starts a negotiation for pro- 
ducing a stream following the steps specified by the 
HAVi spec. The HAVi spec, specifies to make the follow- 
ing inquiries as a pre-process to the producing of 
20 stream connection (step 1803): 

(1) status of using plugs; 

(2) What kind of stream types can the device han- 
dle? 

[0128] The virtual device of GW apparatus 1703 in 
this embodiment acts for the IP device, therefore, the 
virtual device inquiries an actual status of the network 
and holds the band necessary for transmission between 
the GW apparatus and the IP device (step 1804). 
[0129] Next, the virtual device detects a physically 
vacant plug in the GW apparatus per se, and registers it 
in a plug-control-table using stream-port-controller 1 71 7 
(step 1805). 

[0130] In the plug-control-table, following items are 
recorded as shwon In Fig. 20: HUID of the virtual 
device, FCM plug No. which is used as an identifier for 
stream transmittance/receipt used in a protocol, a phys- 
ical Plug Control Register's (PCR) No. specified by IEC 
61883, and a port No. used on the IP side. 
[0131] After these processes, the GW apparatus 
replies to the HAVi device inquiring about the stream 
production via HAVi-stream-controller 1716 (step 1806). 
[0132] When the stream is ready for transmission, 
the HAVi device instructs the HAVi middle wear to trans- 
mit the stream. At this time, an event notice (Connec- 
tionAdded global event) of the stream transmission is 
sent out (step 1807). 

[0133] When the stream arrives at the GW appara- 
tus, an IEC 61883 packet is converted to an IP packet 
for transmitting thereof to the IP device. For instance, a 
DV format is converted to MPEG appropriate data-for- 
mat on the IP if necessary. The GW apparatus sends 
the converted stream to the IP device. 
[0134] In this embodiment the stream-transfer from 
the HAVi device to the IP devic is described. The trans- 
fer on the other way around can be achieved in the 
same manner. 
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[0135] Based on the sequence shown in Fig. 1 9, an 
operation of cutting the stream-connection is demon- 
strated with reference to Fig. 1 7 and Fig. 20. 
[0136] When the HAVi device issues an instruction 
of cutting the stream, the HAVi middle wear sends an 
vent notice (Connection Dropped) of stream-stop to 
the HAVi network. Stream controller 1716 of GW appa- 
ratus 1703 detects this event and searches HUID of the 
source of additional information to the event for the 
plug-control-table shown in Fig. 20 to find the connec- 
tion cut (step 1 902). 

[0137] The GW apparatus specifies the IP connec- 
tion to be cut from the table, and carries out the cut- 
process (step 1903). 

[0138] The entry having been cut out is detected 
from the plug-control-table (step 1904). 
[0139] In this embodiment, the cut process of the 
stream-connection carried out by the HAVi device is 
described. The cut process by the IP device can be 
done in the same manner. 

[0140] The GW apparatus of the present invention 
realizes the stream-transfer between the HAVi device 
and IP device. 

(Exemplary Embodiment 5) 

[0141] A gateway (GW) apparatus in accordance 
with the fifth exemplary embodiment is demonstrated 
with reference to Fig. Fig. 21 - Fig. 26. 
[0142] Fig. 21 is a block diagram illustrating func- 
tions of the GW apparatus. 

[0143] Data Driven Interaction (DDI) data acquirer 
2116 carries out a communication using an HAVi device 
supplying DDI function, and DDI protocol, so that 
acquirer 2116 collects and stores information neces- 
sary for forming a GUI which manipulates the HAVi 
device. User interface (Ul) generator 21 17 converts the 
DDI information to the GUI format (such as HTML, Java 
applet) which is used in general on the internet. Ul gen- 
erator 2117 has information of correspondence 
between DDI Element — elements of HAVi GUI — and 
components (Java Abstract Window Toolkit (AWT)) of 
GUI used in general on the internet. Ul provider 2118 
accepts a request of a communication application 
(WWW browser, etc.) from client-IP-device 2105 on the 
internet, and transmits the converted GUI to cient-IP- 
d vice 21 05. Virtual device 21 1 1 has the following addi- 
tional functions to those described in the first embodi- 
m nt: Device 2111 accepts a request from IP device 
21 05 via the GUI, and communicates to the HAVi device 
with the DDI protocol. In other words, Device 21 1 1 func- 
tions as DDI controller in the HAVi spec. Other elements 
operate as same as those described in the first, second 
and third embodiments. 

[0144] Fig. 22 shows a sequence illustrating an 
operational flow of the GW apparatus acquiring the DDI 
information of the HAVi device after the HAVi device is 
plugged-in. 



[0145] Fig.23 shows a sequence illustrating an 
operational flow where a client device on the intern t 
makes a requ st for the HAVi device via the GW appa- 
ratus using GUI definition information produced by the 

5 GW apparatus. 

[0146] Fig. 24 shows a GUI produced by using the 
DDI information. Fig. 25 shows a part of DDI information 
collected by acquirer 2116. Fig. 26 shows a part of 
source code used in producing the GUI by using the 

10 DDI information shown in Fig. 25, the GUI being 
employed on the internet. 

[0147] The flow from acquiring the DDI information 
to generating the GUI for the IP is described with refer- 
ence to the sequence shown in Fig. 22. 
15 [0148] When HAVi device 2101 is plugged-in HAVi 
network 2102, plug-in detector 2106 detects the event 
(step 2201), then GW apparatus 2103 searches HAVi 
registry 2113 with SEID as a key for the information 
about the plugged-in HAVi device (step 2202). 
20 [01 49] In the device information, an attributive value 
(GULRequirement) reserved in the HAVi spec, i.e. 
whether or not supporting DDI, is registered. 
[0150] When GW apparatus 2103 determines that 
DDI is supported, apparatus 21 03 collects the DDI infor- 
ms mation from HAVi device 2101 with DDI protocol (step 
2203). 

[0151] GW apparatus 2103 stores the DDI element 
acquired by DDI acquirer 2116 as the information 
shown in Fig. 25 (step 2204). 

30 [0152] Next, based on the DDI information stored, 
Ul converter 2117 produces definition information of 
GUI utilizing the knowledge corresponding to compo- 
nents of the GUI on the IP side (step 2205). 
[0153] Fig. 26 shows an example of the definition 

35 information (a program code in this case) produced 
from the DDI information shown in Fig. 25, and the 
example shown describes only the part that handles a 
GUI manipulating event. When "PLAY" button is 
depressed as the GUI manipulating event, a method 

40 called CallDDi() of a server in the GW apparatus is 
transmitted to the HAVi device to be manipulated (target 
HAVI device) together with the identifier of the GUI com- 
ponent (Element ID shown in Fig. 25). Fig. 24 shows an 
example where the components in Fig. 25 are devel- 

45 oped on a GUI panel. In this example, components of 
panel and button are produced using Label text informa- 
tion that is essential attribution to the DDI Element. The 
Element ID is an identifier of the GUI component allot- 
ted by the target HAVi device, and the target device rec- 

so ognizes which component is manipulated with this ID. 
[01 54] Fig. 23 shows a flow of operations how a cli- 
ent-IP-device manipulates an HAVi device via the GW 
apparatus. 

[0155] First client-IP-device 2105 sends a request 
55 of acquiring a GUI from a gen ral Ul such as WWW 
brows r (step 2301 ). 

[0156] In the GW apparatus, Ul provider 2118 
receives this request and starts a communication ses- 
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sion with a target HAVi device using a DDI protocol 
(step 2302), and transfers the GUI produced (step 
2303). 

[0157] IP device 2105 displays components (e.g. 
button) of GUI acquired, and controls HAVi devic 2101 s 
following a user's manipulation. At this time, a method of 
virtual device 21 1 1 in GW apparatus 21 03 is called up 
by an event process indicated by the code described in 
Fig. 26. The information about which GUI component is 
how manipulated is conveyed to virtual device 21 1 . For w 
instance, Element ID = 1 of the GUI component and an 
action (Pressed) are conveyed (step 2304). 
[0158] Based on this information, virtual device 
21 1 1 sends a User Action method of the DDI protocol to 
the target HAVi device with the DDI protocol (step 15 
2306). 

[0159] HAVi device 2101 receives this command, 
then operates as specified by the command, and noti- 
fies a change of status when necessary (step 2307). 
[0160] The server interprets this reply and, if neces- 20 
sary, transfers it to IP device 2105. After this, every time 
IP device 2105 is manipulated by the GUI, the process 
from step 2304 to step 2307 is repeated. 
[0161] If some change occurs on the HAVi device 
(e.g. a tape comes to end) and this change is necessary 25 
to be notified to the IP device, HAVi device 2101 issues 
NotifyDdiChange of DDI protocol (step 2309), the GW 
apparatus transfers it to notify the client of the change 
(step 2310). 

[0162] When the client notifies the end of manipula- 30 
tion (step 2311), virtual device 2111 issues "UNSub- 
scribe () method" of DDI protocol to the target HAVi. 
device, then closes the manipulation session (step 
2312). 

[0163] The GW apparatus in accordance with this 35 
fifth embodiment allows an IP device to display Ul for 
manipulating an HAVi device. 

(Exemplary Embodiment 6) 

40 

[0164] A gateway (GW) apparatus in accordance 
with the sixth embodiment is demonstrated hereinafter 
with reference to Figs. 27 - 29. 

[0165] In Fig. 27, virtual-device-provider-site 2717 
provides a virtual device functioning as a GW on the 45 
internet outside. Device-manufactures and www-sites 
operated by providers are the examples of this site. 
[01 66] Downloader 271 6 accesses to site 271 7 and 
downloads the information about the virtual device into 
th device 271 1 . Downloader 2716 has the information so 
as shown in Fig. 28 about the device to be downloaded. 
Virtual-device-controller 2707 has the following addi- 
tional functions to that described in the third embodi- 
ment: 

[0167] At th plug-in of the HAVi devic , if a virtual 55 
device supposed to function as a G W between this HAVi 
device and an IP device is not included in virtual device 
2711, this particular virtual device should be down- 



loaded to device 2711 from site 2717 by downloader 
2716. The downloader also can download a virtual 
device of a version different from the now-using devic 
for r placing. Other elements function as same as those 
described in embodiments 1-3. 

[0168] Based on the flowchart in Fig. 29, a flow of 
operations of the GW apparatus is described with refer- 
ence to Fig. 27 and Fig. 28 illustrating a table to which 
the virtual device is downloaded. 
[0169] When a new HAVi device 2701 is plugged-in 
HAVi network 2702, HAVi plug-in detector 2706 
receives an event, so that the plug-in is notified to vir- 
tual-device-controller 2707 (step 2902). 
[0170] Next, controller 2707 searches HAVi registry 
2713 for the information about the plugged-in device 
(step 2903). 

[0171] Controller 2707 prepares a virtual device for 
accessing to the HAVi device from the internet (step 
2904). 

[0172] The process discussed above is the same 
as that in the third embodiment. 

[01 73] Controller 2707 checks whether or not a vir- 
tual device for the HAVi device plugged-in on step 2903 
exists in provider-site 271 7, and also checks, if neces- 
sary, a version of the virtual device and determines to 
update the version (step 2905). 

[0174] When the virtual device exists in site 2717 
and the version does not need a version-up, the process 
onward is the same as that described in the third 
embodiment (step 2906). 

[0175] When the virtual device is not available or 
the version should be updated, controller 2707 
searches the information about provider-sites as shown 
in Fig. 28 with the key of device information (device No. 
a type of device, a maker) acquired from HAVi registry 
2713, so that controller 2707 acquires the information 
(URL in this case) about a virtual-device-provider out- 
side the G W (step 2907). 

[0176] Based on this provider's information, down- 
loader 271 6 downloads the virtual device into site 271 7 
via IP network input/output means 2712 (step 2908). 
[01 77] Controller 2707 assigns a pseudo address to 
the virtual device downloaded in the same way as in the 
third embodiment, and registers the virtual device to IP 
directory 271 5, then turns the virtual device into standby 
status (step 2909). 

[0178] The GW apparatus in accordance with the 
sixth embodiment keeps functioning as a GW by acquir- 
ing necessary information from the network when the 
information held by the GW apparatus cannot allow the 
GW apparatus to function as a GW. 
[0179] In conclusion, the gateway (GW) apparatus 
and the method of the present invention realizes the fol- 
lowing functions: 

1. The GW apparatus and the method realize com- 
munications between IP devices and HAVi devices. 

2. The GW apparatus and the method allow a HAVi 
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device to detect a device plugged in the IP network 
and acquire the interface information. 

3. The GW apparatus and the method allow an IP 
device to detect a device plugged in the HAVi net- 
work and acquire the interfac information. 

4. The GW apparatus and the method realize a 
stream transfer between HAVi devices and IP 
devices. 

5. The GW apparatus and the method allow an IP 
device to display Ul for manipulating an HAVi 
device. 

6. The GW apparatus and the method can maintain 
functioning as a gateway by acquiring necessary 
information from the network when the information 
locally held by the GW apparatus is not enough for 
itself to function as the gateway. 

Claims 

1. A gateway (GW) apparatus for communicating 
between networks, said GW apparatus comprising: 

(a) first message input/output means for send- 
ing and receiving a message to/from a first net- 
work; 

(b) second message input/output means for 
communicating a second network based on an 
internet protocol (IP); 

(c) a first plug-in detector for detecting a plug-in 
of a first device to the first network; 

(d) a virtual device functioning a gateway for 
the first device plugged in the first network and 
a second device plugged in a second network 
to communicate with each other; 

(e) a virtual-device-controller for providing said 
virtual device corresponding to the first device 
plugged-in with an IP identifier, for the second 
network accessing to said virtual device, 
responsive to information supplied from said 
first plug-in detector; 

(f) a pseudo-address generator for generating 
a pseudo address for said virtual device to 
communicate with the first device in the first 
network upon receiving a connection request 
from the second device in the second network, 
and for outputtlng the pseudo address to said 
virtual- device -controller; and 

(g) an address-correspondence-controller for 
controlling correspondence between the IP 
identifier and the pseudo address provided to 
said virtual device by said virtual-device-con- 
troller. 

2. The GW apparatus as defined in Claim 1 further 
comprising: 

(h) a second plug-in detector for detecting a 
plug-in of the second device by monitoring n a 
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directory supplying information about the sec- 
ond device in the second network"; and 
(i) a registry register for registering in a registry 
in the first network, 

wherein said controller further acquires th 
information about the second device from the 
directory, and establishes a virtual device cor- 
responding to the second device based on the 
information acquired, 

wherein said GW apparatus allows the first 
device to detect the second device plugged-in 
the second network and acquires interface 
information via the registry. 

3. The GW apparatus as defined in Claim 1 further 
comprising: 

0) a directory register for registering informa- 
tion about the first device plugged-in to the 
directory of the second network, 
wherein said first plug-in detector detects the 
plug-in of the first device by monitoring an 
event in the first network, 
wherein said virtual-device-controller acquires 
information about the first device plugged-in 
the first network from a registry on the first net- 
work, and has said virtual device include a vir- 
tual device corresponding to the first device 
plugged-in based on the information acquired; 
wherein said GW apparatus allows the second 
device to detect the first device plugged-in the 
first network via a registry on the second net- 
work. 

4. The GW apparatus as defined in Claim 3 further 
comprising: 

(k) a stream controller for controlling a stream 
transfer between the first devices on the first 
network; 

(I) a stream-port-correspondence-controller for 
controlling correspondence between a stream 
input/output identifier on the first network and a 
stream port on the second network; 
(m) a stream packet converter for converting a 
stream packet on the first network to a stream 
packet on the second network and vice versa, 
and sends/receives thereof, 
wherein said virtual device establishes a 
stream connection to the second device 
plugged-in the second network, and has a 
stream generator for holding a band when nec- 
essary, 

wherein said GW apparatus transfers a stream 
betw en a device on the first network and a 
device on the second network. 

5. The GW apparatus as defined in Claim 3 further 
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comprising: 

(o) an information acquirer for acquiring infor- 
mation necessary for forming a user interface; 
(p) a user interface (Ul) generator for generat- s 
ing a Ul to be used on the second network 
based on the information acquired; and 
(q) a Ul provider for transferring the Ul gener- 8. 
ated when the second device requests to 
access to the first network, w 
wherein said controller detects a plug-in of a 
device to the first network, and determines 
whether or not the device plugged-in supports 
a protocol on the first network, and when said 
controller determines the protocol is supported, 15 
said information acquirer acquires necessary 
information for forming the Ul by communicat- 
ing with the device, 

wherein said GW apparatus allows the second 
device on the second network to display the Ul 20 
for manipulating the first device on the first net- 
work. 



The GW apparatus as defined in Claim 1 further 
comprising: 



25 



(r) a registry of the first network; 
(s) a downlowder for downloading necessary 
information to said virtual device by accessing 
to an information-provider-site providing infor- 30 
mation about said virtual device; 
wherein said virtual-device-controller detects a 
plug-in of the first device, searches the registry 
for information about the first device plugged- 
in, and acquires the information, 35 9. 
wherein said controller further includes an 
information acquirer for acquiring the informa- 
tion from the provider site based on the device 
information acquired from the registry when 
said controller determines one of two cases; (i) 40 
other cases than a case where said virtual 
device includes a virtual device corresponding 
to one of the first device plugged-in and the 
second device plugged-in, and (ii) a case 
where said controller determines that said vir- 45 
tual device needs to update a software version 
thereof. 



The GW apparatus as defined in Claim 1 wherein 
said virtual device includes: 



50 



(d-1) a connection controller for controlling a 
correspondence between the first device and 
the second device; 

(d-2) a command converter for converting a 55 
first command issued from the first network into 
a second command issued from the second 10. 
network and vice versa; 



(d-3) a command-correspondenc -controll r 
for controlling a correspondence betwe n the 
first and the second commands; and 
(d-4) an address converter for transferring a 
first message issu d from the first network to 
the second network and vice versa. 

A method of gateway for communicating between a 
first device plugged-in a first network and a second 
device plugged-in a second network by using a vir- 
tual device; said method comprising: 

(a) transmitting and receiving a message 
to/from the first network; 

(b) communicating with the second network fol- 
lowing an internet protocol (IP); 

(c) acquiring information about the first device 
by detecting a plug-in of the first device in the 
first network; 

(d) providing an IP identifier to the virtual 
device corresponding to the first device 
plugged-in responsive to the information 
acquired in step (c) for accessing to the virtual 
device from the second network; 

(e) upon receiving a connection request from 
the second device, the virtual device generates 
a pseudo address for communicating with the 
first device plugged-in; and 

(f) communicating between the first network 
and the second network responsive to the cor- 
respondence between the pseudo address 
provided to the virtual device and the IP identi- 
fier. 

The method of gateway as defined in Claim 8 fur- 
ther comprising: 

(g) detecting a plug-in of the second device by 
monitoring a directory which provides informa- 
tion about the second device in the second net- 
work; 

(h) providing the virtual device with an address, 
and registering the address to a registry of the 
first network, 

wherein said step (d) further comprising: 

(d-1) acquiring information about the sec- 
ond device from the directory, and setting 
the virtual device corresponding to the 
second device based on the information 
acquired; and 

(d-2) detecting the second device plugged- 
in the second network from the first device 
via the registry, and acquiring interface 
information. 

The method of gateway as defined in Claim 8 fur- 
ther comprising: 
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11. The method of gateway as defined in Claim 8 fur- 
ther comprising: 

(k) carrying out a stream transfer between the 
first devices of the first network; 
(I) storing a correspondence between an iden- 
tifier of stream input/output plug of the first net- 
work and a stream port of the second network; 
(m) converting a stream packet of the first net- 
work to/from a stream packet of the second 
network, and transmitting/receiving the packet 
converted; and 

(n) establishing a stream connection to the sec- 
ond device plugged-in the second network, and 
holding a band when necessary; 
wherein said method carries out the stream 
transfer between the first network and the sec- 
ond network. 

12. The method of gateway as defined in Claim 10 fur- 
. ther comprising: 

(o) acquiring information necessary for forming 
a user interface; 

(p) generating the user interface to be used in 
the second network using the information 
acquired; and 

(q) transferring the user interface upon a 
request of accessing to the first device from the 
second device, 

wherein said step (d) further comprising: 

detecting the plug-In of the first device; 
determining whether or not the first device 
plugged-in supports a protocol of the first 
network for providing the user interface; 
and 

when determining the first device supports 
th protocol, acquiring information neces- 
sary for forming the user interface by com- 
municating with the first device, 



wherein said method allows the second device 
to display the user interface for manipulating 
th first device. 

13. Th method of gateway as defined in Claim 8 fur- 
ther comprising: 

(r) accessing to an information provider site 
which provides information about the virtual 
device, and downloading the information to the 
virtual device, 

wherein said step (d) further comprising: 

detecting the plug-in of the first device, 
searching a registry of the first network, 
and acquiring the information about the 
first device, 

wherein said step (e) further includes: 

acquiring information from a provider site 
based on the device information acquired 
from the registry when one of two cases is 
determined; (i) other cases than a case 
where the virtual device includes another 
virtual device corresponding to one of the 
first device plugged-in and the second 
device plugged-in, and (ii) a case where 
the virtual device needs to update a soft- 
ware version thereof. 

14. The method of gateway as defined in Claim 8, 
wherein said step (d) further comprising: 

storing a connection between the first and sec- 
ond devices into the virtual device; 
converting a first command issued from the first 
network into a second command, and the sec- 
ond command issued from the second network 
into the first command so that both the com- 
mands can be executed by either one of the 
first and second network; 
storing a correspondence between the first and 
the second commands into the virtual device; 
and 

transferring the message issued from the first 
network and the second network between the 
first and the second networks by the virtual 
device following the connection stored as well 
as the command stored. 



(i) detecting the plug-in of the first device by 
monitoring an event in the first network, 
0) registering the information about the first 
device to a directory which provides informa- 
tion about th s cond d vice in the second net- 5 
work; 

wherein said step (d) further comprising: 

acquiring the information about the first 
device plugged-in the first network from a 10 
registry of the first network, so that the vir- 
tual device includes a virtual device corre- 
sponding to the first device; 
detecting the first device plugged-in from 
the second device via the directory, and is 
acquiring interface information. 
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